DOCUMENT RESUME 



ED 040 605 



24 



EM 008 297 



AUTHOR 

TITLE 



INSTITUTION 
SPONS AGENCY 

BUREAU NO 
PUB DATE 
GRANT 
NOTE 



Tobias, Sigmund; Abramson, Theodore 
The Relationship of Anxiety, Response Mode, and 
Content Difficulty to Achievement in Programed 
Instruction. Final Report. 

City Univ. of New York, N. Y. City Coll. 

Office of Education (DREW), Washington, D.C. Bureau 

of Research. 

BR-8-B-01 5 
15 Feb 70 

OEG-0-8-080015-3697 (010) 

40p. 



EDRS PRICE 
DESCRIPTORS 



EDRS Price MF-$0o25 HC-$2.10 

Achievement, *Anxiety, ^Course Content, ^Programed 
Instruction, ^Response Mode 



To establish an attribute by treatment interaction 
(ATI) between anxiety, stress, and response mode to programed 
instruction, a research design was used which consisted of 
experimentally manipulated variables, stress and response mode, and 
two variables assigned on the basis of test score; the facilitating 
and debilitating anxiety scores of the Achievement 

total of 144 college students were randomly assigned to a stress, o 

nonstrtss group, and to one of three ,he 

response with, and without reinforcement, or to a reading groupj. The 

loarning materials consisted of a linear program with the 

area of heart disease. The program contained 

and unfamiliar to students. Posttests on both types of content were 
administered immediately after the program, and the data were 
analyzed by multiple linear regression. A strong positive 
relationship between facilitating anxiety 
technical program was found. Facilitating 

with stress and response mode for technical material. Debilitating 
anxiety failed to interact with any of the variables for technical 
material, though an interaction with stress for familiar materials 

was found., (Author/SP) 




S090^ 0Q3 



U.t. DEPARTMEHT Of HEALTH. EDUCATION 
ft WELFARE 
OFF ICE OF EDUCATION 
THIli DOCUMENT HAS SEEN •'EFRC^JJ^ED 
EXACTLY AS RECEIVED FROM THE PERSON OR 
ORG«iNIZATION 

VIEW OR OPINIONS STATED DO NECES- 
SARILY REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY. 



FINAL REPORT 



Project No* 8-B-015 
Grent No* OBG-0-8-080015-3697(010) 



The Reletlon^lp of Aiuclety t Response Modet and Content Difficulty to 

« 

Achievement In Programed Instruction 
Slgiund Tobias and Theodore Abramson 

City Cc/Hege» Division of Teacher Education 

City University of New York 



February 15t 1970 



The research reported herein was performed pursuant to a grant with the 
Office of Education, U*S* Department of Health, Education and Vtolfare* 
Contractors undertaking such projects under Government sponsorship are 
encouraged to express freely their professional judgement In the conduct 
of the project* Points of view or opinions stated do not, therefore, 
necessarily represent official Office of Education position or policy* 




0 “ 

Or 



U.S. DBPiUitHBNT OF 
HEALTH, EDUCATION, AND NBLFABE 



Office of EduMitlon 
Bureau of Raseardi 



Table of Contents 



4 

Summary * 

Introduction 

Review of the Literature 

Response Mode to Programed Instruction • 

Anxiety 

Adiievement Anxiety Test 

Method ••••• 

Procedures 

Materials 

Subjects 

Results 

Discussion ••• 

Response Mode 

Time 

Anxiety, Stress and Programed Instruction 

Facilitating anxiety . • 

Stress and anx3.ety 

References 

Appendix A * 



List of Tables 



Table 



1. Multiple Linear Regression Analysis of Achievement Data • . 

2, Means and Standaard Deviations, in Percenters , for 

and Technical Subject Matter for Different Response Modes 



21 

23 



2 * 



Sunmary 

The basic sIm of this study was to establish an attribute by 
treatnent Interaction (ATI) between anxiety « stress, and response mode 
to progrsMd instruction* Subsidiary purposes of the research i«re to 
replicate pipeviouo findings concerning the effect of the mode of respond- 
ing on achlevenent from prograned instruction, and to study the effect 
of facilitating in addition to debilitating anxiety. The research 
design consisted of two experimentally manipulated variables, stress 
and response mode, and two variables assigned on the basis of test 
sooret the facilitating and debilitating anxiety scores of the Achieve- 
ment Anxiety Test. 

A total of 1^ Ss were randonay assigned to a stress, or non- 
stress group, ani to one of three response modes j constructed response 
with, and without reinforcement, or to a reading group. The learning 
materials consisted of a linear program dealing with the area of heart 
<l^g^itse» The program contained an easy section error rate) dealing 
with material generally familiar to Ss, and a more difficult section 
error rate) covering technical content unfamiliar to Ss prior to 
studyi.ng the program. Posttests on both types of content were adminis- 
tered immediately after the program. 

The data were analysed by miatiple linear regression. A strong 
positive relationship between facilitating anxiety, and achievement on 
the tecihidcal program was found. Facilitating anxiety also interacted 
with stress and response mode for technical laatorial. Debilitating 



3 



and^tjt hon*TW, failed to Interact with ary of the variables for 
teehnieal aaterial* though interaction with stress for familiar 
materials was obtained. Finally, previous findings regarding the 
higher achievmaent of the constructed response mode for technical, 

but not familiar, subject matter were replicated. 

The findings involving facilitating anxiety weri conceptualized 
in terms of adiievoment motivation, idiich may be a promising variable 
in ATI research. The superiority of the constructed response mode on 
tedmieal material was interpreted in terms of a response learning 
paradi^i. In situations where responses are not in the repertory, 
constructing the responses, in terms of answers to an instructional 
program, may well lemi to superior achievement. VAiere the responses 
are in the repertory but need to be associated to a new stimulus situa- 
tion constructing the answers may lead to no hi^er achievement than 
other response modes. 

The negative findings concerning debilitating anxiety on diffi- 
cult, technical content raised questions regarding the size of the 
error rate required to evoke, and/or maintain anxiety. It was sug- 
gested that anxiety mi^t Interact with instructional mode only in the 
presence of error rates exceeding If this analysis is supported^ 

ATIs Involving anxiety will continue to be of some theoretical inter- 
est, thou^ hardly pertinent for researdi involving optimal instruc- 



tional methods. 
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Introduction 

Tho •daption of in«tructlon*l attthods to indiridual difforoncos 
^Bong pupils is sa srss of so»o iaportsnco to education* In order to 
asslfn a pupil to the Instructional nethod idxich iwuld result in optimal 
adhieriMBt for him, an interaction is presumed to exist betiwen the 
instruetlonul strategy snd the indiTldual difference variable. Such an 
interaction mould permit one to have some confidence in the assigment 
of a particular pupil idio is hig^ on a specific attribute to one 
instructional methoil and a second pupil i« low on that attribute 
to an alternative method* k serious research effort is, thus, required 
to establish interactions betwesn a variety of individual difference 
variables and instructional strategies in order to permit Uie success- 
ful sssigmsnt of pupils to different Instructional modes* The aim of 
the present report was to study such an interaction betmeen anxiety, 
stress, oontent difficulty, and different instructional methods in the 

ares of programed instruction* 

Raviev of the Literature 

The aptitude by learning treatment interaction (ATI) has 
reosntly becoms the focus of Incrssslng attention (Carroll, 19 ^ 9 )* 

Since su^ infcstigationa are concerned with a idiole array of variables 
along idiich Individuals diffsr, snd ths term aptitude has been closely 
identified with the cognitive domain, it has been suggested (Tobias, 
1969b) that a mora appropriata description of this area mould be the 



by treatment interactiont also giving rise to the now familiar 



ATI abbreviation* 

Crohbaeh and Snow (1969) reported ^at is perhaps the most 
extensive review of ATI research. They concluded that a siibstantial 
researdi effort was needed in order to establish ATIs as a viable con- 
struct in the area of instructional research. This conclusion was not 
dissimilar to that reached by Glaser (196?# 1968) after he reviewed 

the learning literature dealing with ATIs* 

In a review of ATI research using programed materials to imple- 
ment different presentation strategies, it wis concluded (Tobias, 1969b) 
that ATIs with different programing variables had also not boon demon- 
strated* It was suggested that the assumption that a variable was 
actually operative in the research situation on the basis of a test 
score may have been largely responsible for the negative results 
reported in this area. In the area of anxiety, for example, the assump- 
tion that a sisbjeet {§) is as anxious about his performance on a 
brief research task as he is about his day-to-day activities or his 
performance on important examinations might well be unwarranted 
(Tobias & Williamson, 1968) * It was recommended that future research 
assure that the variable being investigated was operative during 
the research task by combining experimental variation with the assign- 
ment of a variable on the basis of test score. This review also 
iiklioated that personal attributes ^ich had an effect on achievement 
in one content area might not have the same effect in another area 
anl that therefore Ss ou^t to bo required to work on more than one 
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type of subject matter. 

This study attempted to test this reasoning by employing both 
measured anxiety and experimentally induced stress, together with dif- 
ferent inodes of responding to programed materials. Content eharacter- 
istics were also varied by employing materials of differing familiarity 
to the subjects. 

Response Mode to Programed Instruction 

The literature regarding achievement differences attributable to 
variations in the mode of responding to programed materials was reviewed 
by Anderson (I967), and by Tobias (I968). It was noted that no achieve- 
ment differences were found in early studies comparing different 
response modes. Whether S responded to a program by constructing his 
responses and then checking their accuracy (constructed response), 
’’thought” the answer without actually constructing his response (covert 
response), picked the answer from one of several available choices 
(multiple choice), or road the program cast in the form of completed 
statements (reading mode) resulted in comparable achievement. 

Holland (I967) suggested that the prevalence of findings of no 
difference among response modes could be attributed to the pregrams 
employed in these investigations. Specifically, studies reporting no 
differences employed programs with hi^ ”black out” ratios. The black 
out ratio was defined as the percentage of words in a frame which could ^ 
be eliminated, or balcked out with a crayon, without significantly 
increasing the program's error rate. Holland reasoned that these 
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Materials were, strictly speaking, not prograns since the blackout 
ratio .indicated that content was introduced without becoiiing response 
contingent. Studies in idildi the constructed response node did lend 
to hi^er adhievenent typically utilised prograns in %iiich the blackout 

ratio was low. 

A diffosrsnt foma*tion regaodlne; the findings on the response 
node issue appears possible. Tobias (1969c) suggested that for oontewt 
with Which Ss have a good deal of prior faniliarity no difference aswng 
response sndes was to be expected. On the other hand, content Wiich was 
new to Ss typically resulted in superior achlevenent with the con- 
structed response node. This position is in accord with the findings 
of a n-*-”* of investigators. Cu«nlngs and Goldstsln (1962), and 

(1963, 1965) found evidence for the superiority of the con- 
structed response node using prograns whose content was described as 
tedinloal. It appeared likely that, in this context, technicality 
nsant that S did not have the opportunity to become familiar with the 

content covered before studying the progran. 

The faniliarity interpretation grow out of tio studies (Tobias, 
1969a, 19690) employing instructional naterlals for idtlch Ss had vary- 
ing prior knowledge. A progran was used covering both technical con- 
tent unfanlliar to Ss, and naterial to Wil«* they had substantial 
pslor es^sure. Both sets of content wore drawn fkon the sane domain, 
the area of heart disease. The familiar portion of the progran con- 
♦ naterial dealing with the incidence of heart disease, and 
risk factors for contracting heart disease such as high eholostoral. 
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iMokltig, ate. The tachnicia. unfamiliar section of the program 

taainl^ with the diagnosis of myocardial infarction from the 
fifth praoordial lead of «ia electrocardiogram. Technical names for 
different degrees of severity of coronary disease, electrocardio- 
graphic tracings diaracteristic of each level of severity, and graphic 
representations of the damage to the heart muscle caused by the 
various levels of coronary disease were included in this part of the 

program. 

The findings of these investigations (Tobias, 1969b# 1969c) were 
In accord with the familiarity formulation. For familiar content, there 
was no difference between the constructed response group and Ss liio 
read the materials. For the t^dinical, unfamiliar subject matter 
significant differences occurred for test units requiring either a 
verbal or a pictorial response. An interpretation of these data in 
terms of the blackout ratio appears possible, thou^ unlikely. The 
blackout ratio for the familiar materials, on lAlch response modes did 
not differ, was higher than the ratio for the technical content. On 
the other hand, the blackout ratio of 24^ for the familiar materials 
was not very hi^ and similar to some programs reporting achievement 

differences between response modes (Holland, 1967)* 

The findings of Karis, Oilhert and Kent (1968) were also in 
aeoord with the familiarity notion. These investigators employed a 
technical program dealing with medical subject matter, and found that 
the constructed response mode led to significantly superior adiievement 
When oynoiyms fbr techidcal were scored as acceptable answers 
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aal apaapOBMla aanld be perafiiraeed in nontecbnlcal laagoagef the ittper- 
ioaritj ef thie oonatracted reap^nee aode ditappe4<*ed. Theee findings 
aogljested that as 8s eould bring their firior !lesrnlng to bear on the 
taskf icO*» ‘Aen the task relied nere on prerlonsly learned aaterial* 
there warn no differences betneen response nodes* 

X>aiiiel and Hiirdo<hL*s (1968) data also support a fanillarlty 
interpretation* These investigators found that a group studying Holland 
aai Skinner's (I96I) program adiieved more than a group studying the 
same subject natter using Skinner's non-prograned writings. The dif- 
ference was based on a nolti-Tariate anslysis of ▼arianee using six 
different achievement induces as dependent measures* khen the suhtest 
noasur^*C knowledge of specific content in the area of operant psychology 
was eliminated from the dependent measures by covsrlancc adjustment the 
diff erenee between the groups was no longer eigxdfiosiit* These results 
indioats that ths oums’sH group differonces hingsd on ths spocific 
eontont snbtost anl» fbrthormors, that specific knoidedgo cf cpcrsnt 
termlaology was probably that part of ths material originally leaat 

familiar* 

Sodtfick and kiOmtmn (I968) found ^at the aOhievemsnt of hie^^ 
soliool aeniOFa on the Holland and Skinner (19^1) program was supsrlor 
to that of a (T^up reading the same natsrisl susmsrissd into succinct 
t«xtbook«liks passages* Howoverf for a group of oollsgs sopbcmofes* 
jamlora# and seniora enrolled in an sducational psychology eourss there 
wore no intil sramsnt differenoes between tkm two wersions* It seams 
likslj that the latter group had a groator f a miliar ity with the concepts 






of optraxxt ’ptjcilaology than did the hic^ school studontst espoeiaUy 
since . goaoral psydhologj Is typically popo-pequisite for «ost edueationsl 
pqrohology cenrses* 

It is not nivoasonsblo to assone that content idth lAilch Ss 
are «**'^*— '<‘^^** nay require a oore overt response for optlnal learning 
than does fsnilisr suhjeet oatter* Lack of fs nill s r ity implies that 
the responses required by the task nsy not be in S's repertory* and 
consequentlyt actually making the response may well be the beat nay of 
nastering it. For familiar subject matter* on the other hand* overt 
responding nsy not be ii^rtant since many of the required responses 
nsy uell be in the repertory* thou^ perhaps not in the specific context 
required bF the naterial* In such a task S does not have to learn how 
to nske the response* but rather how to connect existing responses to 
new* or different situations. Overtly naking a response ukl<di is 
already in the repertory nay not strengthen its association to new 
situations to aiy greater degree than covertly thinking* or reading the 
naterlhl. In terms of response node* this fomulation suggests thgt 
for content in vbieh the required responses have been previously learned 
little achievement difference is to be expected between overt or covert 
responding* choosing from one of several alternatives* or reading the 
material, bhen the responses required by a program are new* actually 
an overt response and receiving knowledge of results concerning 
it* is likely to lead to superior achievement. 

A second purpose of the present investigation was* thus* to 
replicate earlier findings regarding the relationahip between 
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lAth subject setter amd response node to pro^sned 

iiistrttctton* 

Amdsty 

Th«M i* • rtrong r*tioMle for tb« >*l«tloMhip b«ti»ea .weioty 
•nl »nti1 »T<w»ii1~ from prograMd inrtruetlon. Sp«elflo«Hyt 1* w>sld s«*» 
that tlM orgMiMtion, reduction of unoertelnty, end hls#» ratio 

of rolnforceBont ifcloh dharaeterlse aoat irogra»id aaterlala diould be 

edrantageouc for the aehieTeBent of awdoua atudenta. It la, 
therefore, aurprlalag to note that the reaearbh reported relating 
andety to proi^aned inatructlon largely faila to aupport theae 
expectations • 

Ki^t and Saaaenrath (1966) found that awdoua Sa w»rkod faater 
aid nade feuer errora on a linear prograa dealing with teat oonatructlon 
than lean awdoua atudenta. Ho aehleveiaeiit difference, howeuer, wae 
reported between the groiyw. Flynn and Morgan (1966) uaed a 2 I 3 
...ny rf. of uerianoe, with prograned atti oonaentlonal Inatruotlng doCln- 
ing the firat variable, and throe awdety groupa the aeoond, to atudy 
the affeeta of awdety on achleraBont. Ho algnlflcant nain offeeta or 

interaetloiis vere found. 

Laohe (196?) also studied the effects of three levels of test 
amlety on adhieresent. The sesple uas divided into tuo ability groups. 

A linear progran i^ vocabulary uas presented in four different uiysi 

reaponse, optional eonatrueted roaponae, eoTort roaponae, and 
tha medli« raralon. Again, analyaia of varlanco of thia 4X3X2 
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design revealed no signlfioant main effects or interactions. 

. Tobias and UiUianson (1968) divided ooUege* student S^i into 
tiio anxiety groups on the basis of scores on the T^lor Manifest 
Anxiety Scale. A linear program dealing with binary nurtjers was 
presented in three waysi constructed response with and without reinforce 
mentf and in a reading version. An analysis of covariance of this 2X3 
design* with the pretest score as a cover late, revealed no significant 
main effects or interactions for achievement or attitude data. 

CiKspeau (1968) reported a significant interaction between anadety 
feedback in programed instruction. Hifi^ anxiety girls achieved more 
than the low anxiety group in a standard constructed response with 
reinforcement condition. Vfhen the reinforceawnt was removed, however, 
the achievement of the lower anxiety Ss exceeded that of the hi^ 
anxiety group. There were no significant effects for two similar groups 
of boys. These findings are difficult to evaluate for two reasons! 
First, Csmpeau's dependent measure consisted of gain scores from pre- 
to post-test. The difficulty of interpreting such data are outlined 
by CroiAMLCh and Furhy (1969)# by Karrlft (1963)- Second, no data 
coneernlng performance on the porogram, such as error rates or time 
required to complete the program are reported. In the absence of such 
Information Inferences regarding the degree to liiloh anxiety was 
operative during the research situation are purely speculative. 

Several important factors in resesrch on anxiety in other areas 
hav# not been studied in the context of programed instruction. Thus, 
investigations have typically souc^t relatively simple effects. 
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Typic«lly« an anxiety scale was adidniatered and different progrAving 
foraats inpleaented* Prior inTestig^ations have not taken account of 
soae of the complexities reported in experimental investigation of 
the relationship between anxiety and learning. Thus, Campeau took note 
of the fact that porevlous investigations had found sex to be an impor- 
tant vari^le in investigations of anxiety (Sarason, 1963? Lunneborg, 
1964). Inspection of the grand means of her data suggests that had 
the analysis not considered, the sex variable, significant differences 
would probably not have been found. 

Several other factors of importance in previous investigations 
relating anxiety to learning have not been studied in the context of 
programed instruction. One of these Is the relationship between anxiety 
atxi subject matter difficulty. According to the drive theory propos^ed 
by Spence (1958) and Taylor (1956) hi^ anxiety should interfere with 
performance on complex tasks for idiich S*s incorrect responses are of. 
equal, or higher, strength than the correct responses. For simpler 
tasks, where on© predoid.nant response exists relative to other responses, 
anxiety is predicted to have a facilitating effect. Empirical support 
for these formulations have been reported by a nxKtw of investigators 
(Spence, 1964 1 Demv» 1966; Spence A Spence, 1966). No investigations 
have been reported relating anxiety to achievement ft*om programed 
instruction idiich varied the difficulty level of the material to be 
learned. 

Another frequently reported finding in the anxiety literature 
was an interaction between anxiety and stress. Differences between 
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«ndl low uud.o1^ groups occunred oiily under conditions of stress 
(Hicholson, 1958s Ssrsson * Pslols, I960; Ssrsson, 1958). When stress 
wss Assist, no swciety offsets were obserred. As proriously suggested, 
these findings reeaphesiee the laportsnoe of coupUng s wsrlAle assigned 
on the basis of test score with an experlmntal Tsrlatlon to increase 
the probAUity that the wariAle studied is oporAlTe in the rosoarA 

situation* 

The purpose of this study uas to investigate som of these 
amdAy efforts in a neaningf^ learning context using programed materials. 
Speoifically, it was expected that there bo no main effects attributAlo 
to anxiety but, instead, that anxiety would InterAt with situational 
stress. Furthenwre, a triple interaction was prAirted between aiudoty, 
stress, aA response mode. ConstructA response was exportA to bo 
least affectA by anxiety aA stress, aA providing no reinforcement 
nest affectA by it. Finally, the anxiety effects wore expeetA to 
decrease learning on difficult natortals. Aero, on simple content 

aohioTMiont aacpectod to incroaoae 

terletvTeat . The anadoty measure utilisA in this 

investigation was Alport aA HAer-s (i960) AAlevement Anxiety Test 
(AAT). The AAT is oomposA of two subscalosi the AAX+ deals with the 
klA of amdety that facilitates performance in artiovenent Atuatlons, 
aA the UT- items tap the debilitating efforts of aindoty on per- 

foruanea in acdiiava®aitb aituat5x>juim 

Tha ohoioa of tha JUS aa a naasura of amdaty in this inyaati-« 

gation uaa prowptad by aavaral factors. First inong thasa uas tha 
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evidence closely relating this tost to achievement situations. Alpert 
ani Haber (i960) reported that the AAT scales had the folloviiig xaulti- 
ple correlations with academic achievement in three different samples 1 
.54, .50f *32. Correlations between the AAI- and achievement in these 

4 

three samples were -.48* —•45f -•08j correlations for AAT+ being .32* 
•36, and .50. These correlations were relatively unaffected by 
scholastic aptitude. Retest reliability of the scales was .83 and .8? 
over a ten week interval. 

The secozd factor prompting choice of the AAT was the fact that 
relationships similar to those obtained by Alpert and Haber were found 

• ‘ I 

in a pilot study. The AAT was administered to four educational 
p^diology classes at the City College of New York during the Spring* 
1967 semester. Correlations between the AAT+ and grade point average 
were *21«ani -.26 between the AAT- and grade point average. The 
EifLtiple cOiTelations between both scales and grade point average was 
.45. Idien ability* as reflected by SAT scores* was partialled out the 
Boltiple correlation was only sli^tly reduced to .35* These results 
iwiicated that for the population to be used in the present investiga- 
tion the evidence supported the contention that the AAT was related to 
awdety associated with achievement situations. 

Finally* the AAT was adopted because prior data suggested that 
it mi^t interact with response mode to programed instruction. Sub- 
sidiary analysis of previous data (Tobias, 1969c) indicated that the 
AAT scales had the following correlations with total achievement ft'om 
an instructional program in a reading conditioni AAT+ = .40; AAT- = 



-•26. In a constructed response eondltionf however » the correlations 
were ^08. for the and -.17 for the AAT-. Differences between 

these correlations indicated that the AAT predicted achievement dif- 
ferentially in the various instructional conditions t and thus» sug- 
gested that it m±0it well interact with the response node variable. 

Method 

The basic aodel for this investigation was similar to those 
recoDSBonded by Cronbadh and Snow (I 969 ) for ATI studies. Basically 
two independent variables were manipulatedi stress and response mode. 

The degree to which these variables interacted with sex# and anxiety 
assigned on the basis of test scores was determined by multiple linear 
regression tedtniques. 

Procedures 

Administration of the procedures of this study took two sessions. 
In the first of these the AAT, a pretest for the familiar programed 
materialf and some other research scales were administered. The instruc- 
tional program and posttests were administered in the second session. 

Half the Ss who had volunteered for this study were randonOy 
assigned to an induced stress condition. Prior to the beginning of 
the second session the following Instructions were read to this groupi 

"Intelligence has been traditionally defined as the ability 
to learn. In the past ability to learn has been inferred 
from performance on tests with items of general informationt 
reasoning* etc. . . . This procedure has been criticized 
since different people do not have the same opportunity 
to learn these informational items. Our approach to the 



■aasurenant of inteUigence is different. Naaely, 
inferring inteUigence-the .bility to 

*ctu»l perforaence on » loerning task. The learntag task 

eelected is an instructional teaeh^ "*?'*^rf-S^forward— 

The rationale in back of this procedure i®. 

the more people learn from this progr^, the / 

are. Wo mould therefore like you to do yow best o" 

program. Preliminary results ha’/o indicated 

Knale is encouraging. People 

of the program haeo actually done bettor ^ college toan 
those mho hare done poorly. lou mill bo ^^®" * 
deteimine how much you have learned 

It is the score you obtain on this test tha^ mo bel • 
is related to your ability to learn othor things. 

Within this stress condition Ss more randomly assigned to one 



of three presentation modesi tmo constructed response groups, one with 
and one without reinforcement, and a reading group. The instructional 
materlaas mere presented in a booklet format with three frames to a 
page. The confirmation for one frame appeared in the left-hand margin 

of the succeeding £ram» on the next page. 

Of the 72 Ss in the stress condition 70 wore tested at one time 

early in the 1968 semester. This was viewed as essential in order to 
minimise the possibility of foedbaek between the stress and noiwstress 
groups. JJon-stress Ss were typically tested in small groups ranging 
from one to ton, with the single largest administration consisting of 

22 Ss at one tine* 



Materials 

The instructional materials used were identical to those pre- 
vlously employed (Tobias, 1969a, 1969c). The content of the program 
was described shove. The familiar material consisted of the first 54 
frsmes, and the tedinical material of the succeeding 89 Items, k 
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posttest h«3. been previouslof developed covering the familiar end teoh- 
nic«l aeterial. The foailiu- subtest had an aljia reliability of .66, 
ri.pha reliabnities of two technical subtests vere. .86 for the items 
dealing »ith content requiring S to respond «ith drawings, and .85 for 
the verbal items. For the present investigation the latter two sub- 
scales were combined into one scale. The complete constructed response 
program, posttest, arri criteria for scoring those responses requiring 
drawings of ECG tracings can bo found in a previous report (Tobias, 

1968). 

Xhe difficulty of the material was determined by the percentage 
of correct responses to the program. Previous research (Tobias, I 968 ) 
indicated that for the familiar section of the program this percentage 
was 96 . 6 . and 81.3)6 for the technical material, a difference significant 

beyoxxi thtt #001 lovol* 

As a result of Aaierson's (Anderson, Faust, Roderick, 1968) 
report that their Ss were able to see the confirmation through the 
paper, blank pages were inserted and bound into the program booke 
The necessity for turning two pages for each frame is likely to have 
increased the time for the program sli^tly. The no-reinforcement 
version of the progr«a was identical to the constructedHresponse ver- 
aion with the exception of the fact that all of the materials in the 
l,ft-h.«i margins containing the correct answers to the preceding lV«me 
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Subjects 

A total of 144 Ss, 80 of i*o»i were female, participated in thxs 
study. Subjects «ero recruited primarily from educational psychology 
classes at the City College of New York during the Fall, 196? and Spring, 
1968 semesters. Subjects were told that the purpose of the experiiaent 
was to study the relationship between programed instruction and the way 
people Uvink, and wore paid six dollars for their participation. 

Resalts 

The c'ritical dependent measures in this investigation wore the 
scores attained on the posttest. In order to allow for direct com- 
parability between the means of the technical and familiar subtests, 
whidi <»ntainsd a different number of raw score points, scores were 

converted to percentages* 

The data were analysed using the multiple linear regression tech- 
niques outlined by Crohbach and Snow (1969), and by Overall and Spiegel 
(1969), A subject's group membership in the experimental stress and 
response mode conditions was represented by a series of binary vectors. 
The three response mode conditions were expressed by two vectors: 
constructed response was coded 1 and 0, no reinforcement 0 and 1, and 
reading -1 for both vectors. This coding made it possible to replicate 
previous findings with a comparison betxieen only the constructed 
response a«l reeling greups by using the first of the two vectors (Cohen, 
1968). The AAT scales were included in the model as continuous vectors. 
Interactl/an vectors between the experimental variables, and among these 
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«ind the assigned variables were the siBiple products of the component 
vectors. Since previous research had ft-equently reported an interaction 
between sex and anxiety a binary sex vector was added to the analysis. 

The initial analysis sou^t to determine idiether anxiety and 
stress affected the sexes differentially. Interaction vectors were 
thus developed between sex and the AAT vector», and between sex and 
stress. This analysis indicated that there were differential sex 
effects only for the AAT+ (F = 12.90, £ < .001). Therefore, succeeding 
analyses of all AAT-l- effects were conducted within sex by including the 
sex, and AAT+ X sex vectors. The fall model for the analysis of 
achievement data included the vectors mentioned above, plus the main 
effects and only those interaction vectors which were of interest in 
this investigation. The vectors of interest are shown in Table 1. 

The succeeding analysis followed a modified stepdown procedure 
similar to the one described by Overall and Spiegel (1969) * and by 
Cohen (1968). The significance of main effects was tested by forming 
a reduced model containing all the main effects, then testing for the 
significance of each variable by dropping that vector from the model, 
and testing for reduction in the multiple correlation. This procedure 
was followed since some of the main effects were intercorrelated 
(e.g., r between AAT+ and AAT- was -. 36 ) and allowed for the estimation 
of the percentage of variance contributed independently by any variable 



%eta wei^ts, regression coefficients, and other data pertaining 
to the full models appear in Appendix A. 




*E ® *056 Probabilities determined by exact procedrire (Veldman, 

1968). 



^ values less than 1 not sh^:m. 
♦£ = <.05 
*♦£ = <,01 
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•djustad for the effects of all other variables. The second riiodifica- 
tion of the stepdown procedure was to employ the full model, containing 
all of the vectors including those testing for sex interaction, Ss 
SAT and pretest scores for a total of 23 in the denominator, rather 
than only the previous restricted model. This procedure resulted in a 
more conservative test and is recommended by Crohbach and Snow (1969)* 
The interaction effects were examined by adding vectors in the order in 
which they appear in Table 1, and their significance tested by comparing 
them to the prior model, and dividing with the full model in the 
denominator. 

As expected, Table 1, which is reproduced on the preceding page, 
indicates that none of the main effects achieved significance. The 
interaction between the AAT- and stress was significant at the ^ level. 
Inspection of the beta wei^ts for this effect clearly indicates that 
in this condition anxiety irrt.eracted with stress to raise achievement. 

For technical subject matter the response mode main effect is 
of borderline significance, its exact probability being .058. For the 
comparison between constructed response and reading group, F =» 5*21 
significant at the .02 level. Inspection of Table 2, which is repro- 
duced on the succeeding page, indicates that the constructed response 
■ode resulted in significantly hi^er achievement than the reading 
group. This analysis, furthermore, suggests that the borderline sig- 
nificance for the response mode main effect is attributable largely to 
the presence of the no-reinforcement group idiose performance fell 
between that of the other groups. Contrary to expectation, none of the 




Table 2 



Means and Standard Deviations, in Percentages, for Faniliar and 
Technical Subject Hatter for Different Response Modes 



Dependent Measure 


CR 




No Reinforeenent 


Reading 


M 


SD 


M 


SD 


K 


SD 


Faniliar Test 


63.7 


13.7 


63.8 


12.0 


63.8 


11.6 


Technical Test 


63.1 


14.3 


59.9 


13.9 


57.4 


16.5 


Tine on Progran 


86.8 


19.1 


86.9 


17.1 


35.2 


12.0 


Faniliar Progran 


96.5 


3.6 


96.x 


3.2 


— 




Tedbinieal Progran 


78.8 


9.8 


7X.6 


12.0 
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result* inTolving debilitating anxiety, as measured by the AAT~, 
achieved significance. The AAT4- did have both a significant main 
effect* and interaction with apesponse mode and stress for the technxcal 
material. The analysis reported for familiar and technical material was 
also computed for the amount of time taken to complete the popogram. 

This analysis yielded a huge main effect, F « 155 *7 ♦ response mode. 
Inspection of the means in Table 2 indicates that these results are 
attributable to the large difference between the two constructed response 
modes and the reading group with respect to the amount of tiroie taken. 

None of the other effects were significant for the results dealing with 

time. 

• Pata for the percentage of correct responses to the program were 
available only for the two constructed response groups. These data 
were analyzed in the same manner as the achievement data. This analy- 
sis for the tedinical portion of the jpn'oerm yielded oh3.y one signifi- 
cant effect, namely for the response mode variable (F ~ H < •^01). 

The mean percentages for the two response groups, reproduced in the last 
row of Table 2, imieate that the constructed response ©j-oup with rein- 
forcement had a significantly lower error rate on the technical material 
than did the »o-reinforcement group. For the familiar material there 
was no significant difference between the groups. Neither the anxiety 
scales, nor the stress condition singly, or in interaction appeared to 
have a significant effect on the pe 3 rcentage correct on the program. 

Of further Interest were some of the intercorrelations among the 
variables. SAT score correlated .15 with achievement on the familiar 
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nat^rlal *ni with Adii^vt^ant on the technical material t reversing 
the findings of a previous investigation (Tobias • 19^9®) • The correla- 
tions bstsesn the SAT and AAT scores mrB as follonsi AAT- = -.I? t 
AATe « •12. The correlation between achievement on the technical and 

the familiar program mas .43. 



Discussion 

The results of this experiment largely fail to support the 
expected interaction between achievement from programed instruction, 
stress, a»i debilitating anxiety, thought! an interaction with facilitat- 
ing anxiety was founi. Previous findings dealing with the effects of 
response mode to programed instruction were replicated. The implica- 
tions of those data are discussed below. 

ResTwnae Mode 

The present results that constructing responses leads to superior 
adbisvement compared to reading technical materials, but not familiar 
content, replicates previous findings (Tobias, 1969m, c). These data 
strengthen the conception that S's previous familiarity with the 
material is an important variable in determining the optimal response 
mode. On material for lAiich the responses are largely in S’s repertory, 
such as the familiar materials used in this investigation, making an 
overt response apparently does not lead to a superior association of 
that response with the particular stimuli present in the program and 
posttest. The fact that Ss had prior experience with the content was 
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ooBfimad Again by a pra-test mean percentage correct of 24,7 1 * bit 
loimr< than the porevloualy reported pre-score of 31^ (Tobias, 1968), 

On the technical material, for idiich a pre-score of virtual zero was 
found in the prior study, overt responding led to superior learning. 

The comparison between the constmcted response and reading group 
stifongpLy supports the response learning interpretation offered in this 
study. The significance of the findings is obscured by the data for the 
no-reinforcement group, which fell between the groups with respect to 
aehieTement on the technical material. It had been assumed that this 
oondltion would be especially advantageous in a study of anxiety and 
stress. The data iiwiicated that this expectation was not supported by 
the findings. With respect to the response awjde issue , the interpreta- 
tion of these findings in terms of response learning and the variables 
affecting the performance of this group are somewhat complex. An overt 
response mas required, thou^ the correct answer was not provided. 
Despite the fact that explicit reinforcement had been removed, it seems 
clear that implicit confirmation was present. The hierarchal organisa- 
tion, and li'equent review and repetition of the content of prior frames 
present in linear procp*a»s suggests that by going from frame to frame 
Ss porobably receive implicit reinforcement for their responses. 

It may well be of theoretical interest to study the effect of 
eliminating reinforcement from an Instructional program. The present 
findings suggest that this cannot be accomplished simply 1;^ removing 
the reinfosrcement for preceding frames. Combining a no-reinforcement 
oondltion with a scrambled frame sequence wnild remove not only the 
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e^^llclt relxiforcoBent* but *lso the Implicit reinforcement present in 
the frame by frame sequence* Even in such a context* reinforcement 
mould* of course* not have been entirely eliminated* but would be con- 
siderably reduced. 

In previous research (Tobias* 1969c)* achievement on the familiar 
program was significantly oorjrelated with scholastic aptitude idiile 
technical achievement was not. The present investigation essentially 
reversed these findings* The only available explanation for these 
data is to be had in the lower variability, with respect to SAT, of the 
present sample and slightly hi^er aptitude* For the 144 Ss in this 
Investigation the SAT mean was 528*5 with an SD of 91*5* The comparable 
data for the prior investigation (Tobias* I968) were mean 507*5 and SD 

105*6. 

Time 

In accord with the findings of other Investigations present results 
inlicate that both the constructed response groups took significantly 
longer than the reading group to cover the same material. In this study 
overt responding took 2-1/2 times longer than reading the material. 

It is sometimes suggested (Roderick & Anderson, 1968) that such findings 
raise serious que?<tions regarding the efficiency of programed materials* 

A comparison of time required to achieve mastery is meaningful in those 
Instances liien the time required to learn a subject is of equal, or 
greater Importance to the mastery attained. For content such as that 
employed in this study a greater degree of mastery is well worth the 




28 



gTMitar tljw rsqvdrad* One would essune that even if en ECG technician 
had to take twice the tiae to laprore hie knowledge of subject matter, 
the increaaed mastery i» well north the extra time required* On the 
other haid, asking Ss to skim throuf^ materials they have read once 
may Imirove their mastery of the subject matter to the same level as 
working an instructional program, and conceivably at less tine. A 
study of that kind, involving different types of content, mi^t be 
'f%xy revealing with respect to the efficiency issue 

Anxiety^ Stress and Progcaned Instruction 

The expected interaction between debilitating anxiety, stress 
ani response mode to programed instruction was unsupported for technical 
materials, thou^ stress did Interact with anxiety to Improve achieve- 
ment on relatively easy, familiar content. Main effects, and inter- 
actions for facilitating anxiety were confirmed by the data. 

Facilitating anxiety . The AAT+ had a strong main effect, and 
interacted with stress and response mode. These findings confirmed a 
tendency noted in previous data (Tobias, 1968). It is difficult to 
interpret this finding in terms of anxiety theory. Alport and Haber 
(i960) conceptualised this scale as a measure of anx3,ety lAiidh facili- 
tates people's performance in achievement situations* The scale con- 
tains sudi items as the followingi "The more important the exam or 
test, the better I seem to do." "I enjoy taking a difficult exam more 
than an easy one." "Hervousneia while taking a test helps me to do 
In view of the content of these items it is not surprising 



better." 
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"to not® that researchers (McKeachie* 3.969) have suggested that AAT+ 
may be mpre closely related to achievement motivation than to tradi- 
tional conceptions of anxiety. Datta (196?) reported that S^s with 
hl^ AAT- scores tenied also to have hi^ scores on other measures of 
general anxiety while hi^ AAT4- scorers did not. In a factor analysis 
of 46 other personality scales Datta found that the AAT- and other 
anxiety scales had factor loadings below -.40 on a psychological well- 
being factor. The AXT+, on the other hand, had a loading of only .05 
on this factor a»i no hi^er saturation on any factor other than that 

defined by the two achievement anxiety scales. 

The AAT4- findings make sense idien viewed in terms of motivation 
for academic achievement. From this persi>ective it is not surprising 
that Ss with hi^ motivation should achieve more than low scorers, 
yielding the strong AAT+ main effect Furthermore, it is reasonable 
to assume that the female Ss in this study, who aspired to be teachers, 
were more likely to carry out research instructions conscientiously 
than their male counterparts. The correlation of *50 between the AA.T+ 
and technical achievement for females, compared to -.03 for males, is 
in accord with these conceptions and explains the strong AAT+ X sex 
interaction found. These data suggest that the AAT+ may be a fruitful 
measure to employ in ATI investigations studying academic motivation 

among females. 

mmAatv . The result, of this study failed to con- 
fipsi «Is brtween .jBclety, stress, «id response mode to programed 
instruction for difficult materials. One possible explanation of these 
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data is that despite the Induction of stress* anxiety was not clearly 
operative in the situation. The findings of no differences between the 
stress groups for fasiiliar or tedinical content support this possi- 
bility. There wore also no differences attributable to stress on the 
percentage of correct responses to the progran for either type of con- 
tent* or for the amount of time taken to complete the program. Clearly, 
the induced stress failed to have any impact. This was somewhat sur- 
porlsing since a preliminary trial of the stress instructions had indi- 
cated that they had hi^ credibility for the population sampled. The 
best way of ascertaining that anxiety is operative in the research task 
to measure it while Ss are working on the materials, by interspersing 
a brief anxiety scale with the instructional materials (O'Neill, 
Speilberger, A Hansen, 19^9) • 

It should be noted that attributing the present findings to the 
possibility that anxiety was not sufficiently engaged in the research 
situation can not account for the presence of an interaction between 
the AAT- and stress for the familiar, easy materials. 

A more likely explanation of the present data is that the tech- 
nical material was not difficult enou^ to evoke, or maintain, 4>,nxiety. 
The percentage correct for the familiar program, irrespective of response 
mode, was 9^.3 compared to 75*^ for the technical material (t - 14.45* 

£ < .001). The technical error rate was, thus, over six times hi^er 
(3#7 to 24.8) than the familiar. The greater difficulty of the techni- 
cal material does not, however, amwr the question whether an error 
rate of 2^ makes the material difficult enoui^. In a study by O'Neill, 



Splelbergor, and Hansen (19^9) an interaction between task difficulty 
and anxiety was found. Their difficult learning materials, consisting 
of mathematical problems and proofs, had approximate error rates of 
and 605t for two sections. Error rates for the easy material were 
virtually aero* The difficult task was made more complex by the fact 
that Ss cou3.d not advance to the next problem until they solved the 
prior one* Such levels of difficulty are virtually impossible to attain 
with the usual prograsisd materials, since, while txseful for research, 
they are likely to be useless for teaching* In this study, the 
no-reinforcement group had an error rcte of 28.4^ for the technical 
materials, probably as hi^ as any program designed for the purpose of 

teaching anything ou^t to be. 

The present findings, combined with the negative results of 
other attempts to relate achievement from programed inarbruction to 
anxiety question whether such an interaction is to be expected in the 
context of programed, or any other type of Instruction. If the ratio of 
ri^t to wrong responses must be about 2-3*1 in order to demonstrate 
ATIs with anxiety few instrucbiona3 methods would qualify for such an 
interaction* In this study there were clearcut relative differences on 
acquisition error rates between different types of material, and betwaen 
response modes, yet the expected anxiety interaction with stress on 
achievement failed to b© confirmed. This evidence strongly suggests 
that the absolute error rates may well have to be hi^er than those 
presently attained in order to find evidence of ATIs with anxiety. In 
turn this suggests that while such ATIs may be of considerable 



theoretical interest, they may imt be pertinent to the design of 
optini&l instructional strategies e 
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^ Predictors 



VARIABLE 


CCi^RELAT IGN- 


REGRESSION 


BETA 




X VS Y 


COEFFICIENT 




Sex 


-0.06653 


-B.781CC 


-0.70674 


AAT- (A-) 


-G.C2666 


0.227C4 


C. 09885 


Stress (S) 


0.1C236 


-9. 76657 


-0.79112 


Response Mode (RI4) 


-0.0G62C 


1.56612 


0.10356 


Response Mode (Rll) 


-0.00138 


3.43197 


0.22694 


Sex X A- 


-C.C4586 


0.319^9 


0.68406 


Sex X S 


-C.G618A 


12.66668 


1.02443 


A- X S 


0.12619 


C. 43515 


0.94214 


A- X RM 


-O.CllGA 


-0.02775 


-0.04931 


A- X RM 


-G. 01^25 


-0.16373 


-0.28766 


s xm 


0.C3651 


-13.17C9C 


-C. 87093 


S X RM 


0.01653 


18.46966 


1.22133 


A- X S X RM 


0.03GC9 


0.50668 


0.90035 


A- X S X PM 


-C.C1555 


-G. 70963 


-1.24662 


AAT-»- (A+) 


0.09787 


C. 16415 


C. 06354 


A+ X Sex 


-G.07A46 


-0.0343C 


-0.07233 


A+ X Sex X £ 


-0.G6969 


-C.472C7 


-0.99686 


A+ X Sex X RM 


-0 .044A2 


-0.02966 


-0.05128 


A+ X Sex X RK 


-0.07557 


-0.0255C 


-0.04380 


A+ X Sex X £ X HM 


-0.04126 


0.CC655 


C. 01126 


A+ X £ex X S X HM 


0.04162 


G. 01 501 


0.02600 


Pretest 


C . 2 1 4 3 2 


0«21815 


0.19322 


SAT-Verbal 


0.14943 


C»0153C 


C. 11297 



DEPENDEI'^T 

Familier 



IN2EHCErT 39*70926 

KULTiaE R- >QJi3^$6 Miatiple r2- 0^8971 t'E OF EFTIHi Tr - 12,a7568 
SUM OF SCUARES- 11165.03125 ERROR SE- 17789.66797 IVTAL SS- 2195U.69922 

DF DEM(MBIATOK- 120 F^ 1.2215 



2F MI3MERAT0R- 23 




nin JECRSICAL MC®HX 



23 rredactors 



V/iKlABLE 

HAKE 

Sex 

^iAT- (A-) 

Streflfi (S.) 

Hflsponse Mode (HM) 

Eesponse 15cde (RM) 

Sex X A- 

Sex X S 

A- J. B 

A- 

A- X m 
AAT-^ (A-» ) 

A+ X Sex 
.A+ X Sex Z S 
A+ X Sex X Bl‘l 
Af X Sex X m 
M X Bex X S X HM 
A+ X Sex X S X B1 
Pretest 
SAT-Verbal 
DEH’:-XiRHT 
TeeMJMQc. 



CQRRHLAT IGN 

X vs Y 
c. 02574 
-0.22C96 
-0.00862 
0.15631 
0.06935 
0.03885 
*“0.00163 
-0.01086 
0.15745 
0.06453 
-0.10515 
-0.06593 
-0.09650 
-0.C9081 
0.25385 
-0.01954 
-0.02031 
-0.01638 
-0.03942 
C. 06302 
0.15990 
0.23906 
0.41643 



REGRESS ICN 
COEFFICIENT 
11.5555C 
-0.2C368 
-3.49266 
-1.82852 
-0.51195 
0.24551 
15.19918 
0.17112 
0.22379 
-0.00531 
-9.8726C 
14.62915 
G.26616 
-0. 53449 
C. 46078 
-0.7C076 
-C. 59011 
-0.C3053 
-C. 01645 
0.C3834 
G. 10674 
0.12377 
0.06062 



BETA 

0.76746 
-0.07318 
-0.23341 
-0.09976 
-0.02794 
0.43378 
1.01418 
G. 30573 
0.32615 
-0.00769 
-0.53670 
0.79825 
0.39028 
-0.77492 
0.13120 
-1.21934 
-1.02828 
-0.04326 
-C. 02332 
0.0545C 
0.15258 
0.09046 
0.37055 



SE OF F8TWTF.- 



JNTEHCEPT 18,8?59£ 

0.63601 o.iioitso 

SUM CF S OMg 'S" 13Qti2.121Q9. R?R0R f!5?,19<!OOal757.8 ..TCT:'L Sf-. JS?li2.t?S666 

BP >rop:i?AT^-„ ,?3 OT BnraKATCP.- 120 F- 3.Sltl|0 



